Probabilistic verification of partially observable dynamical systems
نویسندگان
چکیده
The construction and formal verification of dynamical models is important in engineering, biology and other disciplines. We focus on non-linear models containing a set of parameters governing their dynamics. The value of these parameters is often unknown and not directly observable through measurements, which are themselves noisy. When treating parameters as random variables, one can constrain their distribution by conditioning on observations and thereby constructing a posterior probability distribution. We aim to perform model verification with respect to this posterior. The main difficulty in performing verification on a model under the posterior distribution is that in general, it is difficult to obtain independent samples from the posterior, especially for non-linear dynamical models. Standard statistical model checking methods require independent realizations of the system and are therefore not applicable in this context. We propose a Markov chain Monte Carlo based statistical model checking framework, which produces a sequence of dependent random realizations of the model dynamics over the parameter posterior. Using this sequence of samples, we use statistical hypothesis tests to verify whether the model satisfies a bounded temporal logic property with a certain probability. We use sample size bounds tailored to the setting of dependent samples for fixed sample size and sequential tests. We apply our method to a case-study from the domain of systems biology, to a model of the JAKSTAT biochemical pathway. The pathway is modeled as a system of non-linear ODEs containing a set of unknown parameters. Noisy, indirect observations of the system state are available from an experiment. The results show that the proposed method enables probabilistic verification with respect to the parameter posterior with specified error bounds. ∗This is an expanded version of a paper submitted originally in January 2014. Parts of this work are based on Benjamin M. Gyori, Probabilistic approaches to modeling uncertainty in biological pathway dynamics, PhD thesis, National University of Singapore, 2014. ar X iv :1 41 1. 09 76 v1 [ cs .S Y ] 4 N ov 2 01 4
منابع مشابه
Verification and Control of Partially Observable Probabilistic Real-Time Systems
We propose automated techniques for the verification and control of probabilistic real-time systems that are only partially observable. To formally model such systems, we define an extension of probabilistic timed automata in which local states are partially visible to an observer or controller. We give a probabilistic temporal logic that can express a range of quantitative properties of these ...
متن کاملPredictive Linear-Gaussian Models of Dynamical Systems with Vector-Valued Actions and Observations
Predictive state representations use probabilities of future events as the state of a partially observable system, as opposed to most classical models, which use probabilistic statements about latent variables as state. We present a new version of the predictive linear-Gaussian model (PLG), a predictive state representation that models discrete-time dynamical systems with real-vector-valued act...
متن کاملPredictive Linear-Gaussian Models of Stochastic Dynamical Systems with Vector-Valued Actions and Observations
Predictive state representations use probabilities of future events as the state of a partially observable system, as opposed to most classical models, which use probabilistic statements about latent variables as state. We present a new version of the predictive linear-Gaussian model (PLG), a predictive state representation that models discrete-time dynamical systems with real-vector-valued act...
متن کاملA POMDP Framework to Find Optimal Inspection and Maintenance Policies via Availability and Profit Maximization for Manufacturing Systems
Maintenance can be the factor of either increasing or decreasing system's availability, so it is valuable work to evaluate a maintenance policy from cost and availability point of view, simultaneously and according to decision maker's priorities. This study proposes a Partially Observable Markov Decision Process (POMDP) framework for a partially observable and stochastically deteriorating syste...
متن کاملProbabilistic Knowledge-Based Programs
We introduce Probabilistic Knowledge-Based Programs (PKBPs), a new, compact representation of policies for factored partially observable Markov decision processes. PKBPs use branching conditions such as if the probability of φ is larger than p, and many more. While similar in spirit to valuebased policies, PKBPs leverage the factored representation for more compactness. They also cope with more...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1411.0976 شماره
صفحات -
تاریخ انتشار 2014